# 128k Long Context Processing

Qwen3 is the latest generation of large language models in the Qwen series, offering a range of dense and mixture-of-experts (MoE) models. Based on extensive training, Qwen3 has achieved groundbreaking progress in reasoning, instruction following, agent capabilities, and multilingual support.

Qwen3-4B is the latest generation large language model in the Qwen series, featuring 4B parameters, supporting a 128k context window and over 100 languages, with outstanding performance in reasoning, instruction following, and agent capabilities.

Meta Llama 3.1 series multilingual large language model, featuring 8B parameters, optimized for multilingual conversational use cases, supporting 8 languages.

A Mixture of Experts model based on Llama 3.2, integrating four 3B models to form a 10B parameter model, supporting 128k context length, excelling in instruction following and full-scenario generation.

Llama-3.3-70B-Instruct is a multilingual large language model released by Meta, optimized for multilingual dialogue use cases and demonstrating excellent performance across multiple industry benchmarks.